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ABSTRACT 



An apparatus for producing pseudo-stereophonic sound 
from a monaural signal including a monaural source 
having a first speaker disposed in an anechoic room and 
having a sound output generated by the monaural sig- 
nal. Second, third, fourth and fifth speaker disposed in 
the anechoic room (substantially) symmetrically about a 
listener having two ears. The monaural signal from the 
source is processed to output processed signals to each 
pf the second, third, fourth and fifth speakers, each 
speaker producing a sound output corresponding to the 
received processed signal. A pair of microphones are 
disposed in the ears of the listener for receiving the 
sound outputs of the first, second, third, fourth and fifth 
speakers and producing two differentiated audio chan- 
nels. 

12 Claims, 5 Drawing Sheets 
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FIG. I 
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by Jens Blauret in "The Psychophysics of Human 

HEAD RELATED TRANSFER FUNCTION Sound Localization", MIT Press, Cambridge, 1983. 

PSEUDO-STEREOPHONY HRTFs have been mentioned in some U.S. patents. 

For. example, U.S. Pat. No. 4,388,494, issued to Schone 

ORIGIN OF THE INVENTION 5 et al describes a pseudo-siereophonic reproduction cir- 

The invention described herein was made in the per- ^^Jl, ^^l**'?"^ j^^'^'^ Similarly, U.S. Pat. No. 

forraance of work under a NASA contract and is sub- 4,359,605, issued to Haramoto et al describes pseudo- 

ject to Public Law 96-5 17 (35 U.S.C. 200 et seq.). The stereophonic signal generation utilizing HRTFs. 

contractor has assigned his rights thereunder to the ^^^^ ^.219.696, issued to Kooure et al. dis- 

Govemment closes stereo signal generation havmg localized sound 

images dependent on HRTFs. U.S. Pat. No. 4,192,969 

BACKGROUND OF THE INVENTION discloses HRTF-related stereophonic signal generation 

1. Technical Field of the Invention S^^^^^ adjustable attenuators for variable fre- 
The present invention relates generally to the field of q^ency correlation and response. 

stereophony and, more specifically, to a head related contmumg need exists for improved pseudo-stereo- 
transfer function pseudo-stereophony in which two Phonic signal generation capable of producing two 
differentiated audio channels are derived from a single ^^'"""^ '^""^ ^""^"^ ^'^"^ ^ "^^'^^^^^^ 
channel. SUMMARY OF THE INVENTION 

2. Description of the Prior . Art a * r *u ^ • 
"PcA.iH^ cf*.r*./^r^v,rt«^," « o »^^^^r> H^^nir^firtr, « objcct of the prcscnt invcntion is to denve two 

Pseudo-stereophony is a genenc description of a differentiated audio channels from a single channel 

family of techniques that allow the denvation of two • ^ ^„ ^, ^ . _ , i ♦ j * r r ^ 

X e ti based on the head related transfer function, 

channels of sound from a monaural! y-recordcd, one a *• • . -j 

. , -t • . I. • r Another object of the present invention is to provide 

channel source. Signa processing techniques for „ j « ^* r j • ^ ^ 

... , * .'^ t. -^jr^i . ^ method and apparatus for producing pseudo-stereo- 
achieving pseudo-stereophony have existed for at least ^ ^^.^^ J^^^^ of the sound timbre in 
thirty-six years a time penod roughly parallelmg the ^^^^ ^j^^^^^, ^ j 
commercial introduction of home stereo systems In f^^^ ^ ^^^^j^ ^j^^^^^j ^^^^^^ ^ 
general, these techniques all involve a process where ^^ject of the present invention is to provide 
the two channels of output are derived according to a ^ ^^^^^^ apparatus for producing pseudo-stereo- 
decorrelation process, i.e., the monaural mput is pro- 30 ^ony in which the listener is not required to be posi- 
cessed to each channel in a differential nianner so as to ^^^^^^ ^he center of two speakers, 
create two non-coherent signals. One technique, known yet another object of the present invention is to pro- 
as differential filtering, uses a high-pass filter for output vide a method and apparatus for producing pseudo- 
channel one and a Ipw-pass fiher for output channel stereophonic output channels which can be mixed to 
two. Other differential fiUenng techmques have used 33 monaural (one channel) without disturbing coloration 
two comb filters with complimentary frequency re- effects that result from phase cancellation, 
sponses, or two all-pass filters with differential phase still another object of the present invention is to 
response. provide a method and apparatus for producing pseudo- 

Another type of pseudo-stereophony can be referred stereophony in which the sound image has an increased 

to as reverberation and time delay techmques where, 40 dimension of spaciousness. 

for example, the technique involves adding differen- jhese and other objects of the present invention are 
tially time delayed, scaled versions of the signal to each ^ei by providing an apparatus for producing pseudo- 
output channel, with the possibility of adding recircu- stereophonic sound from a monaural signal. The appa- 
lated sound. ratus is based on the concept of a monaural source hav- 

Yet another type of pseudo-stereophony involves 45 ing a first speaker disposed in an anechoic room, the 

differential sub-audio frequency modulation of the out- first speaker having a sound output based on the monau- 

put channels. This is sometimes called *'pitch shifting". ral signal, a second, third, fourth and fifth speaker dis- 

The aforementioned techniques suffer from one or posed in the anechoic room substantially symmetrically 

more drawbacks, including the overt •^coloration" of about a listener having two ears, signal processing 

the sounds timbre in each separate channel of the out- 50 means for receiving the monaural signal from the source 

put. Also, with loudspeaker reproduction the listener is and outputting processed signals to each of the second, 

required to sit near the center of the speakers. Further, third, founh and fifth speakers, each speaker producing 

there is a general inability to mix the pseudo-stereo a sound output corresponding to the received processed 

output to monaural without disturbing the tirobral dis- signals, and a pair of microphones, one disposed in each 

tortions. Also, with stereo reverberation techniques, the 55 car of a listener for receiving the sound outputs of the 

problem of additional reverberation time is appreciable. first through fifth speakers and producing two difTeren- 

The sound becomes "muddy" (overly reverberant) as a tiated audio channels. Preferably, the signal processing 

result of convolving an originally reverberant signal means includes a gain unit which increases the monaural 

with the reverberation of the signal processor (and signal to the second, third, fourth and fifth speakers, and 

eventually that of the listening space). 60 four variable delay units, one corresponding to each of 

The pinnae of the human ears are shaped to provide the second, third, fourth and fifth speakers, 

a transfer function for received audio signals and thus In another aspect of the present invention, a method 

have a characteristic frequency and phase response for for producing pseudo-stereophonic sound from a mon- 

a given angle of incidence of a source to a listener. This aural signal includes the steps of feeding a monaural 

characteristic response is convolved with sound that 65 input signal to an A/D converter to produce a digitized 

enters the ear and contributes substantially to our ability output signal, distributing the digitized output signal 

to listen spatially. This is known as the "head related across six lines to produce six digital output signals, 

transfer function" (HRTF). The HRTF was described passing two of the six output signals respectively to left 
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and right summation devices, passing each of the re- 
maining four output signals through individual delay 
devices to establish four different delayed signals, multi- 
plying each of the four different delayed signals by a 
common value, filtering each of the four multiplied 5 
signals through FIR filters having an impulse frequency 
response matching ipsilaieral and contralateral magni- 
tude responses of the head related transfer functions of 
an average listener and a linear phase response to pro- 
duce left and right channel output signals, summing the 10 
left channel output signals with the unprocessed digital 
signal in the left summation device, summing the right 
channel output signals with the unprocessed digital 
signal in the right summation device, and converting 
the summed signals in a D/A converter to produce 15 
analog left and right channel signals. 

These and other features and advantages of the 
method and apparatus for producing pseudo-stereo- 
phonic sound according to the present invention will 
become more apparent with reference to the following 20 
detailed description and drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic view of a first embodiment of 
the present invention; 25 

FIG. 2 is a schematic diagram of the present inven- 
tion showing signal processing corresponding to the 
embodiment of FIG. 1; 

FIG. 3 is a more detailed schematic view of each of 
the eight HRTF filter networks of FIG. 2; 30 

FIG. 4 shows the frequency response for filten based 
on the free-field HRTF for positions at 0 degrees eleva- 
tion, and at 90, 120, 240 and 270 degrees azimuth; 

FIG. 5 shows the group delay response for filters 
based on the free-field HRTF for positions at 0 degrees 35 
elevation, and at 90, 120, 240 and 270 degrees azimuth; 

FIG. 6 shows the frequency response for filters based 
on the monaural HRTF for positions at 0 degrees eleva- 
tion, and at 90, 120, 240 and 270 degrees azimuth; 

FIG. 7 shows the group delay response for filters 40 
based on the monaural HRTF for positions at 0 degrees 
elevation, and at 90, 12, 240 and 270 degrees azimuth; 

FIG. 8 is a schematic view showing angle of inci- 
dence and sequence of delays according to the present 
invention. 45 

DETAILED DESCRIPTION OF THE 
INVENTION 

Referring now to FIG. 1, a pseudo-stereophony ap- 
paratus is generally referred to by the numeral 10 and 50 
includes a monaural sound source 12 having an associ- 
ated speaker 14. The speaker is driven by a sound signal 
produced by the source 12 to thereby generate audible 
sound waves. The speaker 14 is positioned in an an- 
cchoic chamber 16, such as a sound-proof room, di- 55 
rectly in front of a listener 18 having a pair of ears. Four 
additional speakers 20, 22, 24 and 26 arc placed at ear 
level around the listener 18 at 90% 120% 240' and 270' 
azimuth, respectively. These four additional speakers 
receive a processed version of the signal emitted from 60 
the monaural speaker 14. The loudness of the signal is 
first boosted by a gain unit 28 and then is fed in parallel 
to four individual variable delay units 30, 32, 34 and 36, 
each serving one of the four speakers 20, 22, 24 and 26. 

Two probe microphones 38 and 40 are placed inside 65 
the ears of a listener whose pinnae match the average 
shape and transfer function of an average listener. The 
two channel signal for the pseudo-stereophonic output 



4 

is obtained from the output of the two microphones, 
which can be delivered to a left channel speaker 42 and 
a right channel speaker 44 which produce pseudo- 
stereophonic sound for a listener 46. 

Microphones are placed inside of the ears of the lis- 
tener to capture the characteristic frequency and phase 
response for a given angle of incidence from a source to 
a listener, This characteristic response is convolved 
with sound that enters the ear and contributes substan- 
tially to our ability to listen spatially. This is known as 
the "head related transfer function" (HRTF), as de- 
scribed in the aforementioned article by Jens Blauret in 
his article "Spatial Hearing: The Phytophysics of 
Human Sound Localization" MIT Press, Cambridge, 
1983, this article being incorporated herein by refer- 
ence. 

It is possible to simulate the characteristic frequency 
and phase response described above by means of digital 
filtering according to the present invention. An effec- 
tive simulation of the spatial dimensions of sound can be 
achieved by using filters whose impulse response and 
group delay characteristics match the free-field or mon- 
aural HRTF of the two cars of the listener. With speak- 
ers, spatial effects can also be obtained with HRTF 
filtering that are impossible to accomplish with other 
methods. This includes the ability to move the virtual 
sound image beyond the arc defined by stereo loud- 
speakers (so long as each ear is receiving a suitable 
amount of signal from each speaker). 

Referring now to FIG. 2, a signal processing arrange- 
ment according to the present invention mimics the 
heuristic description of the invention shown in FIG. 1. 
The monaural input signal is fed to an analog to digital 
(A/D) converter 48, typically having a 44. 1 kHz sam- 
pling rate and 16 bit word length. The digitized signal is 
then distributed across six lines, numbered 1-6 in FIG. 
2i Lines 1 and 6 pass their signal directly to left and 
right digital summation devices 50 and 52, while lines 2, 
3, 4 and 5 each pass through an individual digital delay 
device 54, 56, 58 and 60. These are either set to fixed 
values or are interactively set by the user as further 
described below. The value of time delay used for lines 

2, 3, 4 and 5 are all different, as will also be described in 
more detail below. 

The output of each delay device 54, 56, 58 and 60 is 
passed through an individual digital multiply device or 
gain devices 62, 64, 66, and 68. The value added to each 
signal by the gain devices is identical and are nominally 
set to a value whereby the signal of lines 2, 3, 4 and 5 are 
each increased by for example, six dB above the ampli- 
tude level of lines 1 and 6. The value of the multiply can 
be adjusted by the user. 

The output of each gain device 62, 64, 66 and 68 is fed 
through a separate HRTF filter network 70, 72, 74, and 
76. As shown in FIG. 3, each HRTF filter network 
includes two FIR (Finite Impulse Response) filters 78 
and 80 whose impulse frequency response matches the 
ipsilateral HRTFs of an average listener at 90, 120, 240 
and 270 degrees azimuth. 0 degrees elevation. Each 
HRTF filter network takes a single input and derives 
two differentiated outputs, one for each output channel, 
using the two separate FIR filters 78, 80 shown in FIG. 

3. The FIR filter 78 for the left output summed at 50 in 
FIG. 3 uses a particular frequency and group delay 
response for a particular angle of incidence, as shown in 
FIGS. 4 and 5, or alternatively in FIGS. 6 and 1. The 
FIR filter 80 for the right output summed at 52 in FIG. 
3 uses the frequency and group delay responses shown 
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in FIGS, 4 and 5. or alternatively in FIGS. 6 and 7, of 
the symmetrically opposed angle of incidence of the 
HRTF measurement used in FIR filter 78. Specifically, 
referring to FIG. 2. HRTF filter network 70 uses an 
HRTF measurement for 90 degrees for FIR filter 78 
and 270 degrees for FIR filter 80-HRTF filter network 
72 uses an HRTF measurement for 120 degrees for FIR 
filter 78 and 240 degrees for FIR filter 80-HRTF filter 

network 74 uses an HRTF measurement for 240 degrees -ri^ r . . a jv. ir ..... 

for FIR filter 78 and 120 degrees for FIR filter 80Tand 10 T^^^^'^* '^^'^ ^"^ ^ ^ 1^ l"^'^^^ ''"^^ ^^l^^* 

HRTF filter network 76 usts an HRTF measurement ^"f ^m"*,^ v'' ' T 

for 270 degrees for FIR filter 78 and 90 degrees for FIR values could also be used, dependmg on the effect de- 
filter 80 creatmg an effective sensation of stereo. A 

The left output channel of each of the four HRTF ^nd B work better for speech but not as well for music 

filtering networks are summed by the digital summation 15 f ?' because the threshold for echo 

device 50, along with the unprocessed output of the disturbance for music is higher than compared to 

A/D converter from line 1, while the right output chan- ^P^^^^* ^ V"'^'ul^^ allow setting the initial 

nel of each of the four HRTFs filter networks is time gap with a knob between 15 and 25 ms and the gap 

summed by the digital summation device 52, along with ^^liy^^" successive reflections between 5 and 10 ms. 

the unprocessed output of the A/D converter from line 20 „^£5j^i'^^ considerations m the implementation 

6. The summed output for the left and right channels are ^.^ ^*i%"^T^ used: the angle of incidence synthe- 

then passed through separate digital to analog (D/A) sized for the particular delay; the sequence of arrival; 

converters 82 and 84 ptiBiSG and frequency response to the filters. The 

The parameters of 'each part of the circuit illustrated °^ incidence used are illustrated in FIG. 8. These 

in FIG. 2, such as time delays, gains, and HRTF filters, 25 f Ll°" measurements made at 0' elevation 

are designed in order to meet specific psychoacoustic < ^^^^^ >• ^"^^^e angles are chosen because of sym- 

criteria described below. ^^^^y (^^-^^O and 240-120), location to the sides (to 

The overall gain of the four delayed sounds are made Produce a stereo effect, filters measured at the locations 

louder than the direct sound through the use of the ^ virtual stereo speaker produces the best results), 

digital multiply or gain devices 62, 64, 66 and 68. Each 30 angles are maximally incoherent with regard to 

of the four delayed sounds is boosted by six dB. This unfiltered monaural source. The sequence is ar- 

was determined empirically as the best value for achiev- ranged so the sound delays alternate twice from left, 

ing the pseudo-stereophonic effect with a range of dif- ^^^n right. This is done so as not to weight the sound 

ferent sound materials, such as speech and music. This '"^^S^ towards one particular side, 

multiply could also be set by the user via knob setting so 35 The FIR filters used accordmg to the present inven- 

that at a minimum setting, the pseudo-stereophony tion are created with a filter design program, based on 

would be effectively by-passed and at a maximum set- an algorithm described by McClellan, Parks and Rab- 

ting, of about J2dB, an exaggerated efi'eci could be iner in their article "FIR Linear Phase Filter Design 

produced. For systems not allowing operator interac- Program" (in Programs for Digital Signal Processing 
tion, about 6dB would be the optimal fixed value. 40 (^^79; New York, IEEE Press)). This is a commonly 

With respect to setting the time delays, each delay ^sed algorithm available in several filter design soft- 
arrives at the loudspeakers differentially in time. The wai-e packages. Each filter uses a 75 tap symmetrical 
following temporal dimensions were taken into account arrangement of coefficients, resulting in a linear phase 
for the setting of each value of delay: (1) the initial time response. Linear phase filters are desirable in that they 
gap between the undelayed sound and the first delay; (2) 45 do not distort the time response of the waveform. If all 
the time between each successive delay; and (3) the time filters used are of linear phase, as with the HRTF filter 
of the final delay, which is a function of the first two network of the present invention, then there is no 
parameters. An important psychoacoustic consideration chance of the combining of the output signals in such a 
is that the signals remain below the level of echo distur- way that their time responses interact constructively or 
bance. Thus, the initial lime delay gap, rather than the 50 non-constructively. 

timing of the final delay, was found to be crucial in this The pseudo-stereophony effect of the present inven- 

regard. The acceptable time delay is also a function of tion can be implemented into hardware using off-the- 

the gain of the delay. For the gains used herein, a range shelf integrated circuit chips, such as a Motorola 56001 

of between 15 and 25 milliseconds (ms) was found useful DSP chip. All of the processing described with respect 
for the initial time delay gap. 55 to FIG. 2 can be accomplished with these or equivalent 

The duration between each successive delay was DSP chips, 

selected to be within a range so that each delay would In the aforementioned embodiment of pseudo-stereo- 

not be heard as a separate sound. For the circuit de- phony, only four HRTF filter networks were used, 

scribed herein, a range of 5 to 10 ms between each However, a larger number of delay-gain-HRTF filter 
successive delay was found to be ideal. 60 networks could be added in an alternative embodiment. 

In order for head related transfer function to create a Fewer or greater number of coeflicients used to repre- 

sensation of increased auditory spaciousness, 30 ms was sent the HRTFs used in FIR filters 78 and 80 could also 

determined as the minimum value for the timing of the be part of an alternative embodiment, 

final delay. This is in line with research into the effect of Other embodiments of the invention may or may not 
early reflections in concert halls. 65 provide a user interface for gain level and time delays, 

Based on these considerations, four sets of time delays as mentioned above, 

were determined for minimum and maximum of delay The results of the present invention provide advan- 

produced by the delay devices 54, 56, 58 and 60: tages over the prior art. For example, the signal, from 
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each channel sounds less "colored** (i.e., timbrally al- 
tered) than with previous methods. Also, a pseudo- 
stereo image can be had from a wide range of listening 
positions, as a result of the complex frequency response 
interaction of the filters. Previous methods require a 5 
more fwcd listening position. The two output channels 
of the present invention can also be mixed to monaural 
(one channel) without disturbing coloration effects that 
result from phase cancellation. Moreover, the sound 
image has an increased dimension of spaciousness. This 
results from the resultant decorrelation of the two out- 
put signals. The present invention also allows multiple 
inputs with differential frequency responses to be more 
easily distinguished from one anotheri compared to 
monaural listening. 

Numerous modifications and adaptations of the pres- 1^ 
ent invention will be apparent to those so skilled in the 
art and thus, it is intended by the following claims to 
cover all such modifications and adaptations which fall 
within the true spirit and scope of the invention. 

I claim: 20 

1. An apparatus for producing pseudo-stereophonic 
sound from a monaural signal comprising: 

a monaural source having a first speaker disposed in 
an anechoic room and having a sound output gen- 
erated by the monaural signal; 25 

a second, third, fourth and fifth speaker disposed in 
the anechoic room substantially symmetrically 
about a listener having two ears; 

signal processing means for receiving the monaural 
signal from the source and outputting processed 
signals to each of the second, third, fourth and fifth 
speakers, each speaker producing a sound output 
corresponding to the received processed signal; 
and 

a pair of microphones, one disposed in each ear of the 
listener for receiving the sound outputs of the first, 
second, third, fourth and fifth speakers and produc- 
ing two differentiated audio channels. 

2. An apparatus according to claim 1, wherein the 
signal processing means includes a gain unit which in- 
creases the monaural signal and four variable delay ^ 
units, one corresponding to each of the second, third, 
fourth and fifth speakers. 

3. An apparatus according to claim 2, wherein the 
second, third, fourth and fifth speakers are disposed, at 
90% 120% 240' and 270* azimuth, respectively. 45 

4. An apparatus according to claim 2, wherein the 
gain unit increases the monaural signal delivered to 
each of the second, third, fourth and fifth speakers by 
about 6dB. 

5. An apparatus for producing pseudo-stereophonic 50 
sound from a monaural signal comprising: 

an A/D converter for receiving the monaural signal 
and producing a digitized output signal; 

means for distributing the digitized output signal 
across six lines to produce six digital signals; 

a left and a right summation device, each receiving 
one of the six digital signals; 

four delay devices, each receiving one of the four 
remaining digital signals and outputting four differ- 
ent delayed signals; 

multiplier means for multiplying the four different ^ 
delayed signals by a common value; 

filtering means for filtering each of the four multi- 
plied signals to produce left and right output chan- 
nel signals; 

the left output channel signals being delivered to the 65 
left summation device and being summed with the 
unprocessed digital signal delivered thereto, and 
the right output channel signals being summed in 
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the right summation device with the unprocessed 
digital signal delivered thereto; 
a D/A converter receiving the summed left aiid right 
output channel signals and outputting two differen- 
tiated audio channels. 
€. An apparatus according to claim 5, wherein the 
filtering means includes four filter networks, each asso- 
ciated with one of the prior delayed signals, wherein 
each filter network includes two FIR filters having an 
impulse frequency response matching ipsilateral and 
contralateral head related transfer functions of an aver- 
age listener and a linear phase response, each of the two 
FIR filters producing one of the left and right output 
channel signals. 

7. A method of producing a pseudo-stereophonic 
sound from a monaural signal comprising the steps of: 

feeding a monaural input signal to an A/D converter 

to produce a digitized output signal; 
distributing the digitized output signal across six lines 

to produce six digital signals; 
passing a first of the six signals to a left summation 

device; 

passing a second of the six signals to a right summa- 
tion device; 

passing each of the remaining four signals through 
individual delay devices to establish four different 
delay signals; 

outputting the four different delay signals by a com- 
mon value; 

filtering each of the four applied signals through FIR 
filters having an impulse frequency response 
matching ipsilateral and contralateral head related 
transfer functions of an average listener and a linear 
phase response to produce left and right output 
channel signals; 

summing the left output channel signals with the first 
unprocessed digital signal in the left summation 
device; 

summing the right output signals with the second 
unprocessed digital signal in the right summation 
device; and 

converting the summed left and right output channel 
signals in a D/A converter to produce analog left 
and right output channel signals. 

8. A method according to claim 7, wherein the four 
different delayed signals are multiplied by a gain 
amount of about 6 dB. 

9. A method according to claim 8, wherein the FIR 
filters correspond to four different angles of incidence 
including 90', 120% 240' and 270% and wherein the 
delay for the 90" filter is 15 ms, the delay for the 270* 
filter is for 20 ms, the delay for the 120* filter is 25 ms 
and the delay for the 240° filter is 30 ms. 

10. A method according to claim 8, wherein the FIR 
filters correspond to four different angles of incidence 
including 90% 120% 240" and 270% and wherein the 
delay for the 90' filter is 15 ms. the delay for the 270' 
filter is for 25 ms, the delay for the 120* filter is 35 ms 
and the delay for the 240* filter is 45 ms. 

11. A method according to claim 8, wherein the FIR 
filters correspond to four different angles of incidence 
including 90% 120% 240* and 270% and wherein the 
delay for the 90* filter is 25 ms, the delay for the 270' 
filter is for 30 ms, the delay for the 120* filter is 35 ms 
and the delay for the 240* filter is 40 ms, 

12. A method according to claim 8, wherein the FIR 
filters correspond to four different angles of incidence 
including 90% 120% 240* and 270% and wherein the 
delay for the 90" filter is 25 ms, the delay for the 270° 
filler is for 35 ms, the delay for the 120° filter is 45 ms 
and the delay for the 240° filter is 55 ms. 
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